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(57)Abstract: 

PROBLEM TO BE SOLVED: To enable quicker and 
simpler information input to a portable communication 
terminal, and provide a portable communication terminal 
information input system, a portable communication 
terminal, a program for a portable communication 
terminal, an analysis server and a portable 
communication terminal information input method which 
connect closely an object with its information. 
SOLUTION: A symbol pattern shown on a bulletin board 
5 is photographed with a digital camera 12 disposed on a 
portable telephone set 1 . A photographed still picture 
image is transmitted to a video processing server 2. 
From the still picture image, the symbol pattern is 
recognized, and converted into corresponding data. On 
the basis of the data after conversion, the server 2 
transfers information held in an information server 3 to 
the portable telephone set. As a result, in the portable 
telephone set 1, the information shown on the bulletin 
board 5 can be linked with more detailed information 

only by displaying the symbol pattern of the bulletin board on an image plane and clicking the 
pattern. 
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* NOTICES * 

iTPO and KCIPI are not responsible £or any 
damages caused by the use of this translation. 

1. This document has been translated by computer. So the translation may not reflect the original 
precisely. 

2. **** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



CLAIMS 



[Claim(s)] 

[Claim 1] The pocket communication-terminal information input system which carries out [ having a 
conversion means provide in a pocket communication terminal, recognize a notation pattem from the 
photography result by photography means photo the notation pattem expressed by the object, and 
said photography means, and change all the this recognized notation patterns into corresponding 
data, and a processing means process based on the data after said conversion, and display the result 
of the processing in said personal digital assistant and ] as the description. 
[Claim 2] ****** matched with processing for the data after said conversion to download the 
information held at the information server on the network which said pocket communication 
terminal connects in said pocket communication terminal ~ the pocket communication terminal 
information input system according to claim 1 characterized by things. 

[Claim 3] It is the pocket commimication terminal information input system according to claim 1 or 
2 which said notation pattem is expressed by the information-display object for displaying 
information, and is characterized by matching the data after said conversion with the processing 
which downloads the information about the information which said information-display object 
shows. 

[Claim 4] Said information-display object is pocket communication terminal information input 
system according to claim 3 characterized by being a poster. 

[Claim 5] Said information-display object is pocket communication terminal information input 
system according to claim 3 characterized by being a signboard. 

[Claim 6] Said information-display object is pocket communication terminal information input 
system according to claim 3 characterized by being a publication. 

[Claim 7] It is pocket communication-terminal information input system given in any 1 term of 
claims 1-6 which said notation pattem is fixed to a specific location, are expressed by the fixation 
object used as the mark at the time of identifying a location, and are characterized by to match the 
data after said conversion with the processing which downloads the map information which shows 
the location where said fixation object is fixed. 

[Claim 8] Said fixation object is pocket communication terminal information input system according 
to claim 7 characterized by being a telegraph pole. 

[Claim 9] The data after said conversion are pocket communication terminal information input 
system given in any 1 term of claims 1-8 characterized by including the information for specifying 
the object showing said notation pattem. 

[Claim 10] The information held at said information server is pocket communication terminal 
information input system given in any 1 term of claims 1 -9 characterized by being the voice data 
outputted in said pocket communication terminal. 

[Claim 11] Said conversion means is pocket communication terminal information input system given 
in any 1 term of claims 1-10 characterized by being installed in the analysis server connected to said 
pocket communication terminal. 

[Claim 12] Processing of at least the part by said processing means is pocket communication 
terminal information input system according to claim 1 1 characterized by being carried out in the 
analysis server which performed said conversion. 

[Claim 13] Said photography result is pocket communication terminal information input system 
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given in any 1 term of claims 1-12 characterized by being the still picture with which all the notation 
. patterns set as the object of said conversion were photoed. 

[Claim 14] It is pocket communication terminal information input system given in any 1 term of 
claims 1-12 characterized by for said photography result being an animation with which N individual 
(N is the natural number) set as the object of said conversion consists of two or more still pictures 
photoed simultaneously, and for said conversion means recognizing each notation pattern from said 
animation, and changing all the recognized patterns into corresponding data. 

[Claim 15] The pocket communication terminal characterized by having a photography means to be 
the pocket communication terminal used for any 1 term of claims 1-14 in the pocket communication 
terminal information input system of a publication, and to photo one or more notation patterns 
expressed by said object, and a display means to display the result of the processing performed 
according to photography of said notation pattern. 

[Claim 16] The pocket communication terminal according to claim 15 characterized by having 
further a conversion means to recognize a notation pattern and to change all the this recognized 
notation patterns into corresponding data from the photography result by said photography means. 
[Claim 17] The pocket communication terminal according to claim 16 characterized by having 
fiirther a processing means to process based on the data after said conversion. 

[Claim 18] The analysis server characterized by having a conversion means to be the server used for 
any 1 term of claims 1-14 in the pocket communication terminal information input system of a 
publication, to recognize a notation pattern from the photography result received from said pocket 
communication terminal, and to change all the this recognized notation patterns into corresponding 
data. 

[Claim 19] The analysis server according to claim 18 characterized by having fiirther a processing 
means to process based on the data after said conversion, and to transmit the result of the processing 
to said personal digital assistant. 

[Claim 20] The program for pocket communication terminals characterized by to have the step 
which acquires the photography result of a notation pattern expressed by the object, the step which 
transmit said photography result to the image processing server which recognizes a notation pattern 
and changes it into corresponding data from said photography result, and the step which display the 
result of the performed processing based on the data after said conversion. 

[Claim 21] The program for pocket communication terminals characterized by having the step which 
acquires the photography result of a notation pattern expressed by the object, the step which 
recognizes a notation pattern and changes it into corresponding data from said photography result, 
and the step which performs processing based on the data after said conversion. 
[Claim 22] The pocket communication-terminal information input approach which characterizes by 
to include the conversion step which is the approach of inputting information into a pocket 
communication terminal, recognizes notation patterns to be the step with which a notation pattern 
expresses to an object, and the step which photo said notation pattern with the photography 
equipment which provides in a pocket conununication terminal from the photography result by said 
photography means, and changes all the this recognized notation pattems into corresponding data, 
and the step which acquire the data after said conversion. 



[Translation done.] 
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* NOTICES * 

JPO and NCIPI are not responsible for any 
damages caused by the use o£ this translation. 

LThis document has been translated by computer. So the translation may not reflect the original 
precisely. 

2.**** shows the word which can not be translated. 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] It is related in this invention to the program for the pocket communication 
terminal information input system for inputting information into a pocket communication terminal, a 
pocket communication terminal, and pocket communication terminals, an analysis server, and the 
pocket communication terminal information input approach by photoing the notation pattern 
especially matched with specific processing or information about the program for pocket 
communication terminal information input system, a pocket communication terminal, and pocket 
communication terminals, an analysis server, and the pocket communication terminal information 
input approach. 
[0002] 

[Description of the Prior Art] In recent years, the method of connecting with communication lines, 
such as the Intemet, and acquiring information as a means for acquiring the newest information, has 
spread. Moreover, the Intemet can be accessed not only when connecting a personal computer (a 
"personal computer" is called below.) to the telephone line, but from pocket communication 
terminals, such as PDA (personal digital assistant) and a portable telephone, and various kinds of 
information can be accessed now. 

[0003] Especially, in a portable telephone, it is always portable, and since it will be in the condition 
which can communicate immediately if a power source is switched on, the Intemet can be accessed 
at any time to acquire information. Moreover, by improvement in the data-processing engine 
performance of not only the characteristic advantage in such a portable telephone but a portable 
telephone, or a bit rate, conventionally, the data which were able to be dealt with only when a 
personal computer was connected to the telephone line can be dealt with, and various processings 
can be performed now. For example, not only a still picture but an animation can be photoed with the 
camera provided in a pocket communication terminal, and an application program required in order 
to transmit and receive it or to deal with such a still picture and an animation can be downloaded and 
performed. 
[0004] 

[Problem(s) to be Solved by the Invention] As mentioned above, even if it is by performing data 
communication using a pocket communication terminal, when wanting, the information on various 
classes can be acquired immediately. However, in order for information to come to hand, the 
keyword for performing retrieval by keyword on URL (Universal Resource Locater) to the WEB 
page which carried information required in order to acquire the information on target, for example, 
the information on target, and a retrieval page etc. must be inputted. On the other hand, since the 
portability is thought as important, as for user interfaces, such as a manual operation button, being 
designed comparatively small is common [ a pocket communication terminal ]. For this reason, it 
was not easy to discover a new product and new language with an advertisement, a poster, etc. in a 
street, when you think that he wants information, for the user of a pocket communication terminal to 
stop in bustle, also when to know further is wished, and to input long URL into a pocket 
communication terminal using a small manual operation button. Also when searching not by URL 
but by the retrieval keyword, long time amount may be taken to arrive at the target information. 
Moreover, when a personal computer arrived to an usable station or a house, it was not able to be 
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said that the information communication function of a personal computer or a pocket communication 
^ terminal was fully demonstrated as he may forget information to know. 
[0005] Furthermore, in the advertisement, the poster, etc., even by having lost the balance of the 
design, even if it displayed URL, it was not fully used and it was not able to be said that information 
displays, such as the advertisement, poster, etc., demonstrated the communicative function 
effectively. The object of this invention is to offer the program for the pocket communication 
terminal information input system which connects an object and its information closely, a pocket 
communication terminal, and pocket communication terminals, an analysis server, and the pocket 
communication terminal information input approach while enabling the quicker and simple 
information input to a pocket communication terminal. 
[0006] 

[Means for Solving the Problem] The pocket communication terminal information input system by 
claim 1 of this invention A photography means to photo the notation pattern which possessed in the 
pocket communication terminal and was expressed by the object, A conversion means to recognize a 
notation pattern and to change all the this recognized notation patterns into corresponding data from 
the photography result by said photography means. It processes based on the data after said 
conversion, and is characterized by having a processing means to display the result of the processing 
in said personal digital assistant. 

[0007] Thus, the information can be incorporated simple to a pocket communication terminal by 
carrying out notation pattemizing and changing the information expressed to an object into the data 
[ handling / data ] in a pocket communication terminal. While being able to raise by this the 
operability of the comparatively small manual operation button of the pocket communication 
terminal which thought portability as important, the function of a pocket communication terminal 
can be used immediately and processing closely connected with the object showing a notation 
pattem can be realized. Moreover, while being connected with the portability and making reading of 
a notation pattem possible always by using the pocket communication terminal possessing a camera 
function as the reading medium of a notation pattem, since a pocket communication terminal can be 
moved that it is lightweight and easily, it can read the notation pattem expressed by various objects, 
such as a fixed object. Moreover, while preventing the portable lowering by forming the equipment 
only for reading in a pocket communication terminal by using an available camera for multiple 
purposes, the notation pattem expressed by the object in the distant location can also be read. 
[0008] ****** matched with processing for the pocket communication terminal information input 
system by claim 2 of this invention to download the information held at the information server on the 
network where said pocket communication terminal connects the data after said conversion in said 
pocket communication terminal in claim 1 — it is characterized by things. By using the 
communication facility of a pocket communication terminal, the information held at the information 
server can be acquired, or many processings can be realized rather than it is closely connected with 
the object of processing [ which is data ] it by the information server. 

[0009] The pocket communication terminal information input system by claim 3 of this invention is 
expressed by the information-display object for said notation pattem to display information in claim 
1 or 2, and the data after said conversion are characterized by being matched with the processing 
which downloads the information about the information which said information-display object 
shows. 

[0010] Thereby, it is acquirable immediately only by the actuation which cannot be displayed on 
information-display objects, such as a poster, and which photos a notation pattem for the information 
related [ data / with which still more detailed information differs from an animation, voice, a 
program (processing instmction in a pocket communication terminal), etc. / of a class ]. Pocket 
communication terminal information input system by claim 4 of this invention is characterized by 
said information-display object being a poster in claim 3. 

[001 1] A poster is put up by the public field etc., since it is the thing of the property which cannot be 
carried out easily, by expressing a notation pattem and enabling activation of the link to related 
information immediately, can perform signal transduction according to a demand of those who 
looked at the poster, and can heighten the signal transduction effectiveness of a poster more. Pocket 
communication terminal information input system by claim 5 of this invention is characterized by 
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said information-display object being a signboard in claim 3. 
- [0012] Pocket communication terminal information input system by claim 6 of this invention is 
characterized by said information-display object being a publication in claim 3. Also in publications, 
such as a book, a journal, and a newspaper, by expressing a notation pattern, time amount and a 
location cannot be asked but still more detailed information can be acquired. Said notation pattem is 
fixed to a specific location, the pocket communication-terminal information input system by claim 7 
of this invention is expressed in any 1 term of claims 1-6 by the fixation object used as the mark at 
the time of identify a location, and the data afl:er said conversion are characterized by to be matched 
with the processing which downloads the map information which shows the location where said 
fixation object is fixed. 

[0013] Thereby, positional information, such as the present address, is grasped, and even if it does 
not know URL for downloading map information etc., a photography person's present location can 
be checked in a map by reading of a notation pattem expressed by the fixation object. Pocket 
communication terminal information input system by claim 8 of this invention is characterized by 
said fixation object being a telegraph pole in claim 7. 

[0014] By assigning each of the telegraph pole installed in the place to reach positional information, 
a its present location can be specified as a detail. Pocket communication terminal information input 
system by claim 9 of this invention is characterized by the data after said conversion including the 
information for specifying the object showing said notation pattem in any 1 term of claims 1-8. 
[0015] Processing of a proper can be matched with the object specified while making the object 
showing a notation pattem identifiable from other objects by this. Information for which the pocket 
communication terminal information input system by claim 10 of this invention is held in any 1 term 
of claims 1-9 at said information server is characterized by being the voice data outputted in said 
pocket communication terminal. 

[0016] As mentioned above, the data of not only alphabetic data but various classes can be obtained 
by using the information held on a network. The information expressed by the information-display 
object can be transmitted to a visually impaired person or an old person by enabling download of 
voice data especially. Pocket communication terminal information input system by claim 1 1 of this 
invention is characterized by installing said conversion means in the analysis server connected to 
said pocket communication terminal in any 1 term of claims 1-10. 

[0017] The program for conversion etc. is held in the pocket communication terminal used as what 
has comparatively small storage capacity, and it becomes unnecess£iry to perform the processing by 
performing transform processing to the data of a notation pattem in an analysis server connectable 
from a pocket communication terminal. Moreover, a response with a notation pattem and translation 
data can be unified and managed. Pocket communication terminal information input system by claim 
12 of this invention is characterized by performing processing of at least the part by said processing 
means in the analysis server which performed said conversion in claim 1 1 . 

[0018] In the analysis server holding the data after conversion, while a response with the data after 
conversion and processing can be made unific compared with the case where it processes by 
processing, by each pocket commxmication terminal, the overlapping communication link traffic by 
returning the data after conversion to a pocket communication terminal can be controlled. Pocket 
communication terminal information input system by claim 13 of this invention is characterized by 
said photography result being the still picture with which all the notation patterns set as the object of 
said conversion were photoed in any 1 term of claims 1-12. 

[0019] By photoing at once the notation pattem which should be changed, the unit of conversion can 
be clarified and it can change by simple recognition processing. The pocket communication terminal 
information input system by claim 14 of this invention is an animation with which N individual (N is 
the natural number) from which said photography result is set as the object of said conversion 
consists of two or more still pictures photoed simultaneously in any 1 term of claims 1-12, and said 
conversion means is characterized by to recognize each notation pattem and to change all the 
recognized patterns into corresponding data from said animation. 

[0020] Since many notation pattems which cannot be photoed at once by using an animation can be 
used, many data can be made equivalent to a notation pattem. The pocket communication terminal 
by claim 15 of this invention is a pocket communication terminal used for any 1 term of claims 1-14 
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in the pocket communication temiinal infomiation input system of a publication, and is characterized 
by having a photography means to photo one or more notation patterns expressed by said object, and 
a display means to display the result of the processing performed according to photography of said 
notation pattern. 

[0021] The pocket communication terminal by claim 16 of this invention is characterized by having 
further a conversion means to recognize a notation pattem and to change all the this recognized 
notation pattems into corresponding data from the photography result by said photography means in 
claim 15. The pocket communication terminal by claim 17 of this invention is characterized by 
having further a processing means to process based on the data after said conversion in claim 16. 
[0022] The analysis server by claim 18 of this invention is a server used for any 1 term of claims 1- 
14 in the pocket communication terminal information input system of a publication, and is 
characterized by having a conversion means to recognize a notation pattem and to change all the this 
recognized notation pattems into corresponding data from the photography result received from said 
pocket communication terminal. 

[0023] In claim 18, the analysis server by claim 19 of this invention processes based on the data after 
said conversion, and is characterized by having further a processing means to transmit the result of 
the processing to said personal digital assistant. The program for pocket communication terminals by 
claim 20 of this invention is characterized by to have the step which acquires the photography result 
of a notation pattem expressed by the object, the step which transmit said photography result to the 
image processing server which recognizes a notation pattem and changes it into corresponding data 
from said photography result, and the step which display the result of the performed processing 
based on the data after said conversion. 

[0024] The program for pocket communication terminals by claim 21 of this invention is 
characterized by having the step which acquires the photography result of a notation pattem 
expressed by the object, the step which recognizes a notation pattem and changes it into 
corresponding data from said photography result, and the step which performs processing based on 
the data after said conversion. 

[0025] The pocket communication terminal information input approach by claim 22 of this invention 
Are the approach of inputting information into a pocket communication terminal, and with the step 
with which a notation pattern is expressed to an object, and the photography equipment provided in a 
pocket communication terminal It is characterized by recognizing a notation pattem from the step 
which photos said notation pattem, and the photography result by said photography means, and 
including the conversion step which changes all the this recognized notation pattems into 
corresponding data, and the step which acquires the data after said conversion. 
[0026] Even when it does not match a notation pattem and processing, information can be inputted 
into a pocket communication terminal simply and promptly only by photoing a notation pattem by 
matching a notation pattern with specific data, without using a comparatively small manual operation 
button. In the step with which a notation pattem is expressed to an object, a direct notation pattem is 
filled in and printed or there are approaches, such as sticking on an object, combining the sticker 
showing each notation pattem with which writing materials, ink, etc. were used for the object, and 
the format was defined etc. two or more sheets. Moreover, in this step, matching with a notation 
pattem and the data after conversion is also performed. 
[0027] 

[Embodiment of the Invention] Next, the gestalt of operation of this invention is explained with 
reference to a drawing. In addition, the part equivalent to other drawings is shown by the same sign 
in each drawing referred to in the following explanation. 

(Pocket communication terminal information input system) The configuration of the pocket 
communication terminal information input system by the gestalt of this operation is shown in 
drawing 1 . As shown in this drawing, pocket communication terminal information input system is 
constituted including a portable telephone 1 , Network NW, the image processing server 2, and the 
information server 3. 

[0028] In addition to a voice call function, a portable telephone 1 also has data communication 
facility and the Intemet communication facility, and can perform transmission and reception of e- 
mail, and access of a WEB page. Furthermore, in the gestalt of this operation, it has a digital camera 
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12 and photography of a still picture and an animation can be performed. Moreover, the static image 
photoed with the digital camera 12 can be saved in the form of JPEG (joint photographic 
expertsgroup) etc., and it can transmit to above-mentioned mail or a WEB page as an attached file, 
[0029] Network NW is a network connectable [ with a communication line ] from a portable 
telephone 1. The portable telephone 1 in the gestalt of this operation is connectable not only with a 
telephone network but the Internet network as mentioned above. The image processing server 2 is 
connectable with a portable telephone 1 through Network NW. In the gestalt of this operation, 
photography results, such as static-image data transmitted from a portable telephone 1, are received, 
and a notation pattem is recognized from the received photography result. Then, the image 
processing server 2 can perform processing which changes all the recognized notation patterns into 
corresponding data. Moreover, it can also process based on the data after conversion. About this 
notation pattem and corresponding data, it mentions later. 

[0030] The information server 3 is a server connected to a portable telephone 1 and the image 
processing server 2 through Network NW. This information server 3 releases the information held 
inside to the connected portable telephone 1 grade, permits database access or processes 
modification of the information held inside etc. according to the demand of the client to connect. 
[0031] Hereafter, a procedure until processing corresponding to a notation pattem is performed is 
explained with reference to the flow chart of drawing 2 from the photography of the notation pattem 
4 expressed with the notice plate 5. In step S201 of drawing 2 , the notation pattem expressed with 
the notice plate is photoed with the camera which a portable telephone possesses. In the gestalt of 
this operation, in order to use this system, the application program of a portable telephone is started. 
If this application is started, entry- form 1 lA as shown in Screen 1 1 of a portable telephone 1 at 
drawing 3 will appear. This entry- form 1 1 A specifies the range of the image used as the object for 
recognition by defining the starting point and the terminal point of recognition of a notation pattem 
by reference point 1 IB which were established in that upper left and lower left. For this reason, 
when photoing the notation pattem 4, all the notation pattem notation pattems 4A, 4B, 4C, and 4D 
that should be changed take a photograph so that it may project within the limits of reference point 
1 IB of this entry-form 1 1 A. All the four notation pattems 4A, 4B, 4C, and 4D expressed with the 
notice plate all over drawing take a photograph so that it may be settled within the entry-form 1 1 A 
limit. If photography of a notation pattem is decided, it will shift to step S202. 
[0032] In step S202, the static image photoed in step S201 is transmitted to an image processing 
server. In step S203, recognition of the notation pattem from a static image and an extract are 
performed in the image processing server which received the static image. Then, the recognized 
notation pattem is changed into corresponding data. In the gestalt of this operation, this data is URL 
which shows the location of the information which the information server 3 holds. 
[0033] The image processing server in the gestalt of this operation performs not only recognition 
processing of an image but processing based on the data after conversion as mentioned above. For 
this reason, if it recognizes that the data after conversion are URL, an image processing server will 
acquire the information which the information server specified by that URL holds, and will transmit 
it to a portable telephone (step S204). Thereby, even if it does not input long URL with a 
troublesome input, the information is downloadable in the screen of a portable telephone, 
immediately after photography (step S205). 

[0034] Thus, with the camera provided in a portable telephone, by photoing the notation pattem 
expressed with the notice plate, it can replace with the manual entry of long URL using the small 
manual operation button of a portable telephone, and the directions to a portable telephone can be 
inputted. Moreover, an above-mentioned application program performs the step which acquires a 
photography result, and the step which transmits the photography result to an image processing 
server after acquiring a photography result. In the gestalt of this operation, processing of a 
convention of the input range of an image etc. is also performed further. It is good also as replacing 
with the application program installed in the portable telephone, and performing same processing by 
WEB access. In this case, WEB pages, such as an image processing server for performing image 
processing, are accessed, and in the entry form of a WEB page, a photograph is taken, and a 
photography result is attached and it transmits. 

[0035] It is good also as changing in a portable telephone with an application program, without the 
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image processing server 2 performing recognition and transform processing of a notation pattem. In 
this case, as shown in the arrow head R2 of drawing 1 , based on the data after conversion, direct 
access will be carried out to the information server 3 from a portable telephone. Therefore, the step 
which acquires a photography result, the step which recognizes a notation pattem from a 
photography result, the step changed into the data which correspond from all the recognized notation 
pattems, and the step which performs processing according to the data after conversion are 
performed. The step which performs processing according to the data after this conversion is not an 
indispensable step. For example, if it tums out that the notation pattem deals with URL beforehand, 
it is good also as what changes into data the photography result inserted in the URL input location, 
and is inputted into a URL input location as it is. Transform processing can be performed without 
connecting with performing this transform processing with an application program, then a network. 
It becomes unnecessary conversely, to hold a program by the image processing server as mentioned 
above to the storage of performing transform processing, then a capacity comparatively smaller than 
the usual information processor. Moreover, since the response relation between a notation pattem 
and data is systematically manageable in an image processing server, it can respond to response- 
related modification etc. promptly. 

[0036] In addition, let these application programs be available things by download to a portable 
telephone. 

(Notation pattem) The example of a notation pattem is shown in dr awing 4 and drawing 5 . The 
simple notation which is easy to recognize from an image is used for the pattem attached on the 
surface of an object as shown in these drawings. The notation pattem shown in drawing 4 forms the 
pattem with which each differs by preparing the shade of a color in each part of one notation. In this 
drawing, 16 kinds of pattems are formed by dividing a notation into four fields and dividing into the 
existence of a color. In drawing 5 , 34 kinds of pattems are constituted by combining the existence of 
the head configuration of an arrow head with whenever [ number / of two or less straight lines /, and 
4 kinds of tilt-angles ], and, them. The notation pattem used in the gestalt of this operation is not 
restricted to what is shown in drawing. The notation pattem which is easy to recognize a difference 
of each pattem can be created by considering change prepared in each element, such as an include 
angle, a line, a point, and a color, only as change which is [ existence / the ] easy to recognize, and 
combining each element. 

[0037] Moreover, in the gestalt of this operation, in order to read a notation pattem, a camera is used. 
Therefore, as shown in drawing 1 , what combined two or more notation pattems 4 not only in one 
can be read at a time. For this reason, when there is a pattem as X by one notation pattem, the static 
image of 1 with which four notation pattems were photoed can be made equivalent to X4 kind 
different data. 

[0038] Furthermore, as shown in drawing 6 , notation pattem groups [ which consist of four notation 
pattems the digital camera 12 provided in a portable telephone 1 ]E [ 4 ], 4F, and 4G, and four H 
pattem top is moved as shown in an arrow head Y, and the animation with which the still picture 
which photoed each notation pattem group consists of four sheets is photoed. From this animation, 
XI 6 kind different information can be expressed each notation pattem group and by recognizing 
each notation pattem further. Thus, more information can be expressed by using an animation. 
[0039] Moreover, if it can recognize by photoing that whole with a camera, especially the magnitude 
of this notation pattem will not be limited. Therefore, if a big notation pattem is expressed to a 
building etc., a notation pattem can be used for an information input even from the distant location 
which can photo the whole notation pattem. 

(The object which displays a notation pattem, and the content of processing) Next, the processing 
based on the object which displays this notation pattem, and corresponding data is explained. 
(1) Express to the information-display object of publications, such as the advertisement and notice 
plate with which the wall of a poster, and an advertising poster hung in a train and a building etc. 
expresses a notation pattem, a guide plate, and a book, a joumal, etc. which displays information. 
And the data corresponding to a notation pattem shall specify the information held at an above- 
mentioned information server like [ it is a thing about the information displayed on information- 
display objects, such as a poster, and ] URL. 

[0040] For example, the notation pattem corresponding to URL of the WEB page which an event 
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sponsor establishes on the poster which tells holding of the event put up over the station etc. is 
expressed. By photoing the notation pattern expressed by this poster using the camera which those 
who looked at this poster possess in their own portable telephone, a WEB page is accessed 
automatically and the still more detailed information about an event is displayed on the screen of a 
portable telephone. 

[0041] The information expressed to what can be moved [ guide plate / the poster put up by the 
public field nor / neither / of a station ] by this can be displayed in its own hand. Moreover, what is 
necessary is just to photo a notation pattern with a camera, in order to make it display. For this 
reason, information to acquire can be acquired on that spot immediately, without carrying out the 
manual entry of the long URL which approached and was displayed small to a portable telephone, or 
making confusedly a note of the date, a reference, etc. of the event which stopped and was written to 
the poster etc. Moreover, big advertising ******^ such as a wall of a building, can also access a 
WEB page by photoing a notation pattern by the same approach. 

[0042] That is, when the notation pattern equivalent to the link mark expressed by the object is 
settled on a photography screen with the sensation same with clicking the link mark on the screen 
which displays a WEB page, it can link to the information relevant to the object by carrying out the 
depression of the manual operation button. Thereby, a real object and the information about it are 
connected more nearly seamlessly. 

(2) Fix a notation pattern to a specific location like a telegraph pole, a building, and a road sign, and 
express to the fixation object used as the mark at the time of identifying a location. And the data 
corresponding to a notation pattern shall be map information which shows the location where a 
fixation object is fixed, and shall specify the information held at an information server. 
[0043] For example, it replaces with the notation of the name of a place expressed with the 
conventional telegraph pole, and an address, or combines with it, and the notation pattern 
corresponding to URL to the WEB page showing a map is expressed. When those who are looking 
for the destination photo the notation pattem with a camera, the static image of a notation pattem is 
transmitted to the image processing server 2 of drawing 1 . The image processing server 2 recognizes 
a notation pattem from the static image, and changes it into the URL data showing a map. The image 
processing server 2 which has recognized that it is URL is accessed at the information server 3, 
acquires the content of the map page, and transmits it to a portable telephone 1 . Or the URL data is 
transmitted to a portable telephone 1, and the browser of a portable telephone 1 which received 
accesses the WEB page of the URL, and displays a map page on the screen of a cellular phone. 
[0044] The data after conversion are not restricted only to the data corresponding to URL, and have 
data which include the information for requiring specific processing in the information, the image 
processing server 2, the information server 3, and portable telephone 1 in which camera stations, 
such as lat/long information with the exact location which photos a notation pattem, are shown. 
Namely, what is necessary is just to be able to perform processing for displaying the map 
information held at the information server on the network which a portable telephone connects 
directly or indirectly in a portable telephone with the equipment which receives the data. 
[0045] For example, when the data after conversion are the information which shows a camera 
station, in the image processing server 2 or a portable telephone 1, it distinguishes to data that the 
data after conversion and conversion £ire positional information. And the map database set to connect 
beforehand is accessed, the camera station information is retrieved as conditions, and a map is 
acquired as a retrieval result. Into what kind of thing the data after these conversion are made decides 
on the amount of information which can be expressed with a notation pattem, the expandabiUty by 
the increment in the processing to which it is made to correspond, and an object in consideration of 
the convenience at the time of attaching a notation pattem etc. 

[0046] Thus, positional information with a high precision can be acquired by [ of the notation 
pattem ] reading by expressing a notation pattem with each identifiable installation with the 
telegraph pole installed in the everywhere in a town. From GPS (global positioning system) etc., this 
is a simple system, and even if it is in a building, it can pinpoint an exact location, and it can acquire 
the positional information corresponding to the location immediately. 

[0047] Moreover, since positional information with a high precision can be acquired easily in this 
way, it can use effectively also as the its present location display of an amusement park, a 
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department store, etc., and an information advice system. For example, the notation pattem 
corresponding to the positional information regularly set to the street LGT in each point of an 
amusement park, a bench, etc. in the amusement park is expressed. The initial entry to the 
information server holding the map information corresponding to that positional information is also 
included in this notation pattem. By photoing those notation pattems, the map in the amusement park 
around a camera station is displayed on a portable telephone. Moreover, it can hold to an information 
server and can be made to display in a portable telephone also about information, such as vehicle 
advice of the circumference of it, and routing to a destination. 

(3) Include the information for specifying the object showing a notation pattem as the data 
corresponding to a notation pattem. In this case, a notation pattem can be effectively used by 
expressing that notation pattem to other objects, such as goods of the same class, and a baggage 
article at the time of a travel, and the object which is hard to identify especially. 

[0048] For example, the tag showing a notation pattem which is different in each of a tourist at the 
time of the travel in an ensemble is passed. After packing collective loading in a passenger transport 
or a bus and keeping it temporarily, the notation pattem which handed over to loading and was 
sometimes expressed with the tag is read. The notation pattem of a tag is distinguishable from other 
tourists' loading which is easy to mix up since it changes with each tourists. The notation pattem of a 
tag and a consignor's authentication distribute the stock tag showing the same notation pattem as a 
tag etc. together with a tag, and perform by comparing whether a tag and a consignor's notation 
pattem are in agreement. Or you may attest by matching the notation pattem of a tag, and the tourist 
information beforehand registered into a database etc., and making a pocket communication terminal 
display the tourist information on photography and coincidence of the notation pattem of a tag. In 
this case, for example, transform processing to destination country language is further added to 
display processing of tourist information. Thereby, also in the case of traveling abroad, 
authentication with the guide of a site etc. is attained. 

[0049] In addition, the notation pattem corresponding to the identification information of the goods 
is expressed to each goods. And the data changed by this notation pattem can be used for stock 
control, article management, etc. of goods by matching with the processing which displays the 
consumption length of those goods on a portable telephone etc. Thus, without using dedicated 
devices, such as a bar code scanner, by using the camera provided in a portable telephone, and the 
information held on a network, matching with various information can be performed freely and it can 
use in various scenes. 

[0050] Furthermore, since a notation pattem is read with a camera as mentioned above, it can use 
also for management of an outdoor building, a building, a vehicle, a container, etc. by displaying a 
notation pattem greatly. 

(4) Let information to download be voice data by reading a notation pattem. For example, a notation 
pattem is expressed with the guide plate with which the local information installed in the station 
front was displayed. By photoing this notation pattem, from an information server, the information 
displayed on a guide plate downloads as voice data, and is reproduced through the loudspeaker of a 
portable telephone. Thereby, only by a visually impaired person, an old person, etc. photoing a 
notation pattem, also when it is in the part which cannot be touched by hand when there are no 
Braille points and it has damaged, and there is much amount of information, the content of a display 
of a guide plate can be acquired at its own hand, and can be repeatedly heard over many hours. In 
this case, the range of a notation pattem is enclosed in braille etc., and is expressed. Moreover, the 
function to tell that the application for the photography and data conversion which were mentioned 
above is also photoed with voice by the range which can be photoed and the notation pattem can 
recognize is prepared. 

[0051] 

[Effect of the Invention] As explained to the detail above, the information can be incorporated 
simple to a pocket communication terminal by carrying out notation pattemizing and changing the 
information expressed to an object into the data [ handling / data ] in a pocket communication 
terminal. While being able to raise by this the operabihty of the pocket communication terminal to 
which a manual operation button benefits improvement in portability comparatively small, the 
function of a pocket communication terminal can be used immediately and processing closely 
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connected with the object showing a notation pattern can be realized. 

[0052] Moreover, the acquisition of the information about the object can be immediately enabled by 
photography of a notation pattern expressed by the object by matching a notation pattern with the 
link to the information about the object showing it. Furthermore, a notation pattern expresses the 
positional information of the object showing it. While being able to pinpoint the detailed location of 
those who took a photograph by reading this notation pattern, even if it does not grasp the location, 
map information corresponding to that location can be made acquirable. 

[Translation done.] 
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